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INTRODUCTION 


In  an  ideal  situation,  one  is  presented  with  a  set  of 
failure  data  in  which  every  piece  of  data  indicates  that  a 
failure  has  taken  place,  i.e.,  one  has  information  on 
f ai lure s  and  on  failures  on ly .  In  this  simplest  of  situa¬ 
tions,  parameter  estimation  may  be  carried  out  in  a  variety 
of  relatively  simple  ways. 

More  often  than  not,  however,  this  situation  is  not 
the  case;  instead,  one  is  presented  with  a  number  of  indi¬ 
cated  failures  and  some  additional  information  on  items 
which  have  been  tested  to  varying  degrees,  but  not  to 
failure.  The  reason  for  lack  of  further  testing  on  the 
unfailed  specimens  may  be  an  economic  one  or  it  may  be 
that  the  unfailed  items  have  been  discarded  for  virtually 
any  reason.  Irrespective  of  the  reasons  involved,  the 
data  has  been  " censored"  ,  i.e.,  someone  has  either  pur¬ 
posely  or  inadvertently  prevented  us  from  seeing  just 
exactly  when  some  of  the  items  tested  will  fail.  This 
report  deals  with  the  general  method  of  maximum  likelihood 
as  applied  to  this  general  censoring  problem. 
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2.  MULTINOMIAL  PROCESS 


The  multinomial  process  is  of  central  importance  in 
the  derivation  of  the  censored  likelihood  function.  A  mul¬ 
tinomial  process  is  simply  the  repeated  performance  of  an 
experiment  £  /vj  times  where  the  experiment  has  (mutu¬ 

ally  exclusive  and  exhaustive)  outcomes  with  associated 
probabilities.  A  description  of  the  process  may  be  abbre¬ 
viated  symbolically : 

Perform  experiment  B  SV1  times  where  the  out¬ 
comes  of  £ 


are  : 


<$■ 

and 


=  -fj.  ■  ■  ■ r 


Repetition  of  experiment  E  may  be  viewed  as  a 
composite  exper 
is  : 


iment  ,  a  typical  outcome  of  which 

C 


^  (9 


m 


are  observed.  The  probability  of 

this  typical  outcome  of  A"  is  given  by: 

v — < 


4 


/ 


/>7  '  m>  ^ 


(  1) 


This  formula  is  given  in  any  elementary  statistics 
text  under  the  heading  "mult inomial  distribution.”  It 
should  be  noted  that  is  merely  the  proba¬ 

bility  of  an  out  come  of  ZT~  ;  in  general  one  wants  the 
probability  of  an  event  (aggregation  of  outcomes).  An 
event  is  given  by  a  set  of  conditions  on  the  . 

Therefore , 


(such  that  the  satisfy 

condition  A) 
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3. 


LIKELIHOOD  FUNCTION 


The  principle  of  maximum  likelihood  dictates  that  we 
find  the  parameters  which  maximize  the  theoretical  proba¬ 
bility  of  obtaining  the  results  we  actually  did  obtain, 
i.e.,  other  results  "should"  be  less  likely  than  the 
actual  results. 

The  theoretical  probability  of  obtaining  the  observed 
results  must  therefore  be  obtained  first.  The  event  des¬ 
cribing  the  observed  results  is:  fail  at 


specific  times 


and  V  -xU. 

survive  for  various  lengths  of  time  ^  4  #  ' 

'  '  ^  without  failing  +•  K  ~  .  Pictorial- 

ly ,  the  actual  test  results  will  look  like: 


A  theoretical  one  by  one  test  of  each  item  to  failure  may 
be  viewed  as  a  multinomial  process  with  the  following  out 
comes  ( for  ). 
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(0=  -PC  6  (ycK  ,  ~XH  +&*) 

K  V 


is  elsewhere. 


Strictly  speaking,  these  outcomes  are  not  mutually  exclu¬ 
sive  in  a  set  theoretic  sense;  they  are  in  a  measure  theo¬ 
retic  sense,  however,  and  this  is  sufficient.  This  abuse 
of  notation  should  be  tolerated  here  for  the  sake  of  bre¬ 
vity  . 


If  unc^er^y^n®  density  function  and 

is  the  distribution  function,  the  probabilities  correspond¬ 


ing  to  these  outcomes  are: 
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Now  that  £  has  been  specified,  the  probability  of 
obtaining  the  observed  results  in  a  theoretical  test  of 
/Y1  items  to  failure  is  desired.  The  event  describing 
the  observed  results  is: 


and 
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The  probability  of  obtaining  the  observed  results  is 
therefore : 


7  “A  A  ^ 


(3) 


hi 


i'-i 


IT 


& 


w 


4^4 


(4) 


^  ~  / 


^4= a; 


where  ,  — 


su 


ch  that 


These  sums  are  to  be  taken  over  all 

jjj?  Jfz.  ^4  ^for  all  /V  ^ 

^1=1^  / 

That  is,  for  each  term  of  the  sum,  all  must  be 

assigned  and  they  must  be  assigned  such  that  for  all  Ak i 
The  symbol  denotes  "implies." 
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The  likelihood  function  is  therefore  defined: 


(5) 


This  expression  may  be  written  logarithmically: 
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Equation  (5)  may  be  written  more  succinctly  if  one  of  the 
products  is  factored  out: 


-  5  rr 


Consider  the  case  when 

terms  for  s  in  this 

given  by  the  table: 


s  ay 
case  ; 


the 


.  There  are  five 
for  each  term  are 


A 

Jk„ 

^3 

1 

1 

1 

0 

2. 

1 

1 

0 

2 

5, 

0 

1 

2 

$ 

0 

0 

3 
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An  important  special  case  arises  when 


'2_ 


In  this  case,  all  terms  of 


vanish  except  one;  the  maximization  of  the  likeli¬ 
hood  function  is  therefore  considerably  easier.  The  like¬ 
lihood  function  will  in  general  be  amenable  to  maximization 
only  through  an  approximate  numerical  method.  Such  a 
method  may  involve  taking  the  first  or  second  partial 


derivatives  of 


with  respect  to  the  parameters 
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